Remote control of electronic devices via mobile device

ABSTRACT

Devices and systems are provided for controlling electronic devices using a mobile remote control device. A mobile remote control device provides an interface to control a plurality of electronic devices. The mobile device has a unique identifier, and the electronic device transmits a presentation of a remote control to the mobile device. A user of the mobile device controls the electronic device by operating the “virtual” remote control displayed on the mobile device. The user may further define his or her custom remote control. The user may define batches of commands, or “macros” that transmit a specific series of commands to one or more electronic devices. Proximity and motion of a mobile device may be used as an input, such that the electronic devices are programmed to react in specific ways depending upon the position and movement of the user of the mobile device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/865,869 filed May 4, 2020, which is a continuation of U.S. patentapplication Ser. No. 15/581,844 filed on Apr. 28, 2017 (now U.S. Pat.No. 10,678,400), which is a continuation of U.S. patent application Ser.No. 14/567,232 filed on Dec. 11, 2014 (now U.S. Pat. No. 9,671,928),which is a continuation of U.S. patent application Ser. No. 12/963,214filed on Dec. 8, 2010 (now U.S. Pat. No. 8,937,534). All sections of theaforementioned applications and patents are incorporated herein byreference in their entirety.

FIELD OF THE DISCLOSURE

The present subject disclosure relates to electronic devices. Inparticular, the present subject disclosure relates to remote control ofelectronic devices using a mobile device.

BACKGROUND OF THE DISCLOSURE

The electronic world has undoubtedly revolutionized our conceptions andabilities to communicate, educate, and entertain. Starting with thedevelopment of transducers and displays, past the subject disclosure ofthe microprocessor, and arriving at today's microcomputer-driven andnetwork-capable electronics, one may conclude that we are truly immersedin the next generation of electronic interactivity. However, oneparticular aspect of today's electronics industry still remainsstagnant—the remote control. No matter how technologically advanced thedisplay and processing technology might be in the latest flat-screentelevision, the remote control still remains an archaic controlmechanism. The same options, layouts, and standards have existed fordecades, and carry with them the same host of yet-unresolved problems.Take for instance the ubiquitous infra-red (IR) remote control. Itrequires a line of sight to operate, which means that a user must pointthe remote control at the electronic device for it to work. Even then,sometimes buttons have to be pushed several times to achieve the desiredeffect. Moreover, each original equipment manufacturer (OEM) has theirown remote control layout for their specific device. Considering howmany electronic devices the typical living room contains, the severalremote controllers for each electronic device each has its own layout,takes up space, and needs batteries. It would be nice to control moredevices (such as home appliances) with remote controls, but who wantsmore remote control devices lying around?

Several subject disclosures in the field attempt to overcome theseissues. The most common of these is the universal remote control.However, this approach has its own set of problems. Namely, thetraditional programming of the remote control for new devices is atedious process. Further, batch processing of commands to electronicdevices is not properly handled by traditional universal remotes. An IRuniversal remote that attempts to control a plurality of devices at atime often gets the sequence of signals mixed up, leading tounpredictable or undesired results. BLUETOOTH radio may be used as analternative to IR. However, BLUETOOTH is costly, and present-dayBLUETOOTH devices are expensive, and do not adequately address theconcerns involved with controlling multiple electronic devices. Theyalso suffer the same complexities when it comes to programming theremote control for a new electronic device. Finally, certain companieshave incorporated remote control software into existing devices such assmartphones and PDAs. However, such network-based remote controls mightnot work with devices outside a certain proximity Generally, allpresent-day technologies have the problem of programming the remotecontrol for new devices, as the operator of the remote control has to doall the work. Consequently, the problem of the learning curve for newdevices is never truly resolved, whether it comes to using new remotecontrol devices or programming existing ones for new devices. Moreover,present day technology does not alleviate issues such as finding lostremotes, using the wrong remote for the wrong device, controllingnon-traditional devices (such as home appliances, HVAC systems, etc.),and offering permissions of control to different users.

What is therefore needed is a means to control one or more electronicdevices using a single remote that does not have to be manuallyprogrammed

The present subject disclosure solves the above problems by controllingelectronic devices using a mobile remote control device. A mobile remotecontrol device (or simply “mobile device”) is equipped with a displaythat provides an interface to control a plurality of electronic devices.The mobile device receives a presentation of controls that includecommands to control one or more of the plurality of electronic devices.The mobile device has a unique identifier, and the electronic devicetransmits the presentation to the mobile device upon verifying that theunique identifier has permission to control the electronic device. Themobile device displays the controls on its display, and establishes acommunications path with the electronic device. A user of the mobiledevice controls the electronic device by operating the “virtual” remotecontrol displayed on the mobile device, for instance, by touching atouchscreen display that is displaying the virtual remote control. Theuser may further define his or her custom remote control, and commandthe mobile device to map the received presentation of controls to thecustom remote control provided by an application or software within amemory of the mobile device. The remote control application may displaya plurality of electronic devices on its user interface, and the usermay select which device or combination of devices to operate via theremote control. The user may define batches of commands, or “macros”that transmit a specific series of commands to one or more electronicdevices. Various communications paths may be set up depending on thetype of network being used and the capabilities of the electronicdevices. Proximity and motion of a mobile device may be used as aninput, such that the electronic devices are programmed to react inspecific ways depending upon the position and movement of the user ofthe mobile device.

In one exemplary embodiment, the present subject disclosure is a mobileremote control device, including a memory, a processor in communicationwith the memory, a transceiver in communication with the processor, adisplay in communication with the processor, an input device incommunication with the processor, and logic on the memory fortransmitting a unique identifier, receiving a presentation of a remotecontrol from an electronic device across a network, the presentationincluding an identity of the electronic device, and displaying theremote control on the display. The mobile logic is further for receivingan input from a user via the input device, mapping the input to acommand on the remote control, and transmitting the command to theelectronic device. The mobile remote control device further includescustomization logic on the memory for enabling a user to define a customremote control and mapping the received presentation of the remotecontrol to the user-defined custom remote control.

In another exemplary embodiment, the present subject disclosure is asystem for remotely controlling an electronic device. The systemincludes a mobile device having a mobile processor, a mobile memory, amobile transceiver, a display, and an input device, wherein thetransceiver enables communication across a network, an electronic devicehaving a device transceiver to enable communication across the network,device logic on the electronic device for broadcasting an identity ofthe electronic device, receiving a unique identifier of the mobiledevice, and transmitting a presentation of a remote control of theelectronic device to the mobile device via a communication path on thenetwork, and mobile logic on the mobile device for transmitting theunique identifier, receiving the presentation of the remote control, anddisplaying the remote control on the display of the mobile device.

In yet another exemplary embodiment, the present subject disclosureincludes a system for remotely controlling an electronic device. Thissystem includes a mobile device having a mobile processor, a mobilememory, a mobile transceiver, a display, and an input device, whereinthe transceiver enables communication across a network, an electronicdevice having a device transceiver to enable communication across thenetwork, device logic on the electronic device to broadcast an identityof the electronic device and to receive a unique identifier of themobile device, and mobile logic on the mobile device for transmittingthe unique identifier, receiving a presentation of a remote control forthe electronic device, and displaying the remote control on the displayof the mobile device, wherein the presentation of the remote control forthe electronic device is transmitted by a provisioning device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a system for remotely controlling electronic devices,according to an exemplary embodiment of the present subject disclosure.

FIGS. 2A and 2B show the components of a mobile remote control device,according to an exemplary embodiment of the present subject disclosure.

FIG. 3 shows a communication path between an electronic device and amobile remote control device, according to an exemplary embodiment ofthe present subject disclosure.

FIGS. 4A and 4B respectively show an OEM presentation and a custompresentation on a mobile device, according to an exemplary embodiment ofthe present subject disclosure.

FIG. 5 shows a remote control application displayed on a mobile device,according to an exemplary embodiment of the present subject disclosure.

FIGS. 6A and 6B show a system for remotely controlling electronicdevices in a hotel room, according to an exemplary embodiment of thepresent subject disclosure.

FIG. 7 shows a system for controlling elevators using proximity andmotion-sensing, according to an exemplary embodiment of the presentsubject disclosure.

DETAILED DESCRIPTION OF THE DRAWINGS

The following disclosure presents a novel technique for controllingelectronic devices using a mobile remote control device. A mobile remotecontrol device (or simply “mobile device”) is equipped with a displaythat provides an interface to control a plurality of electronic devices.The plurality of electronic devices is capable of receiving signals fromthe mobile device, and may be network-ready by virtue of transceiversincorporated within. The mobile device receives a presentation ofcontrols that include commands to control one or more of the pluralityof electronic devices. In some embodiments, the electronic device itselftransmits the presentation to the mobile device. In related embodiments,the mobile device has a unique identifier, and the electronic devicetransmits the presentation to the mobile device upon verifying that theunique identifier has permission to control the electronic device. Ineither case, the mobile device displays the controls on its display, andestablishes a communications path with the electronic device. A user ofthe mobile device controls the electronic device by operating the“virtual” remote control displayed on the mobile device, for instance,by touching a touchscreen display that is displaying the virtual remotecontrol. The user may further define his or her custom remote control,and command the mobile device to map the received presentation ofcontrols to the custom remote control.

Mobile logic for performing these tasks and displaying the interfaces isprogrammed as an application or software within a memory of the mobiledevice. In some embodiments, presentations from a plurality ofelectronic devices are received at the mobile device. The mobile logicthen displays the plurality of electronic devices on its user interface,and the user may select which device or combination of devices tooperate via the remote control. The user may define batches of commands,or “macros” that transmit a specific series of commands to one or moreelectronic devices. Various communications paths may be set up dependingon the type of network being used and the capabilities of the electronicdevices. Further, the user's identity, personal preferences, anddifferent device configurations may be stored on the mobile memory foraccess. Moreover, the “constellation” of devices enables proximity andmotion of the mobile device to be used as an input, such that theelectronic devices are programmed to react in specific ways dependingupon the position and movement of the user of the mobile device. Theseand other novel features of the present subject disclosure are describedin greater detail below with reference to the figures.

For the purposes of the following disclosure, the term “mobile remotecontrol device,” or “mobile device,” refers to any electronic devicecapable of wirelessly sending and receiving data. A mobile device mayhave a processor, a memory, a transceiver, a display, an input, and anoutput. Examples of such devices include cellular telephones, personaldigital assistants (PDAs), portable computers, etc. The memory storesapplications, software, or logic. Examples of processors are computerprocessors (processing units), microprocessors, digital signalprocessors, controllers and microcontrollers, etc. Examples of devicememories that may comprise logic include RAM (random access memory),flash memories, ROMS (read-only memories), EPROMS (erasable programmableread-only memories), and EEPROMS (electrically erasable programmableread-only memories).

“Logic”, as used herein and throughout this disclosure, refers to anyinformation having the form of instruction signals and/or data that maybe applied to direct the operation of a processor. Logic may be formedfrom signals stored in a device memory. Software is one example of suchlogic. Logic may also be comprised by digital and/or analog hardwarecircuits, for example, hardware circuits comprising logical AND, OR,XOR, NAND, NOR, and other logical operations. Logic may be formed fromcombinations of software and hardware. On a telecommunication network,logic may be programmed on a server, or a complex of servers. Aparticular logic unit is not limited to a single logical location on thetelecommunication network.

An “electronic device,” according to the present subject disclosure, isany machine or device that is operable or controllable by a mobiledevice. The term most commonly refers to consumer electronics such astelevisions, set-top boxes, audio systems, video-game consoles,computers, home appliances, and so on. However, in some embodiments, theterm is extended to any electronic or mechanical devices, such as thosein heating/ventilation/air conditioning (HVAC) systems, door locks(including those in buildings, cars, etc.), elevators,lighting/windows/curtains, and so on. Other examples will become evidentin light of this disclosure. Electronic devices generally have storedwithin them logic that enables them to transmit presentations of theirremote controls based upon original equipment manufacturer (OEM)specifications. Electronic devices are therefore able to communicatewith a mobile device either via a direct connection or via a network,and may also be connected or daisy-chained with other electronicdevices.

Mobile and electronic devices may communicate with each other and withother elements via a network, for instance, a wireless network, or awireline network. A “network” can include broadband wide-area networkssuch as cellular networks, local-area networks (LAN), wireless LAN(Wi-Fi), near-field communication (NFC) networks, etc. Networks includecombinations of networks, such as the Internet. On the other hand, anetwork includes an ad-hoc peer-to-peer network, such as a directconnection between two devices. Communication across a network ispreferably packet-based; however, radio and frequency/amplitudemodulations networks can enable communication between communicationdevices using appropriate analog-digital-analog converters and otherelements. Communication is enabled by hardware elements called“transceivers.” Mobile devices may have more than one transceiver,capable of communicating over different networks. For example, acellular telephone can include a cellular transceiver for communicatingwith a cellular base station, a Wi-Fi transceiver for communicating witha Wi-Fi network, and a BLUETOOTH® transceiver for communicating with aBLUETOOTH® device. In some embodiments of the present subjectdisclosure, a communications path is set up between a mobile device andone or more electronic devices. The communications path may traverse oneor more different types of networks.

For the following description, it can be assumed that mostcorrespondingly labeled structures across the figures (e.g., 101 and201, etc.) possess the same characteristics and are subject to the samestructure and function. If there is a difference between correspondinglylabeled elements that is not pointed out, and this difference results ina non-corresponding structure or function of an element for a particularembodiment, then that conflicting description given for that particularembodiment shall govern. The only exception is method steps (S101, S301,etc.) that need not be correspondingly labeled.

FIG. 1 shows a system for remotely controlling electronic devices,according to an exemplary embodiment of the present subject disclosure.System 100 includes mobile device 101, electronic devices 121, 123, 125,and 127, network router 120, wide-area network 140, technicalsupport/provisioning 145, and building 150. As shown, mobile device 101is in wireless communication with electronic devices 121, 123, 125,router 120, and network 140. This wireless communication is aradio-frequency (RF) based communication, including but not limited tocellular, Wi-Fi, BLUETOOTH, NFC, etc. Further, electronic devices 121,123, and 125 are able to communicate with each other and with router 120via any known technology, including audio/video (AN) links such as RCA,digital audio, RF, HDMI, etc., as well as other packet-based links suchas ETHERNET, Wi-Fi, etc. In other words, any electronic connectionenabling a transfer or exchange of data is possible between electronicdevices 121, 123, 125, router 120, and appliance 127. Moreover, router120 provides connectivity to a wide-area network (WAN) 140. As a networkhas been defined to include one or more types of networks, WAN 140includes broadband networks, gateways, mobile networks, and theInternet. Consequently, mobile device 101 is also shown to be inwireless communication with network 140, via a 3G or similartransceiver. A back-end 145 of network 140 provides technical support,provisioning, and billing services. Finally, building 150 includes aplurality of electronic devices that are able to communicate acrossnetwork 140. Building 150 includes homes, offices, storage units, etc.,as well as the components thereof and within.

In operation, logic onboard mobile device 101 enables detection of anyelectronic device within a proximity of mobile device 101. This is madepossible by enabling the electronic devices to broadcast an identifierthat is capable of being detected by mobile devices such as mobiledevice 101. Transceivers incorporated within each of electronic devices120, 121, 123, 125, and 127 enable such a broadcast. For instance,router 120 includes an 802.11 wireless LAN (W-LAN) transceiver, andlogic for broadcasting a service set identifier (SSID). The SSID merelyincludes a short string indicating a name or other definable attributesof the network. A W-LAN transceiver on mobile device 101 detects theSSID. Similarly, set-top box 121 includes a transceiver, such as aBLUETOOTH transceiver, which broadcasts its identity to other BLUETOOTHdevices in the vicinity. The transceiver is provided for a number ofapplications, such as data transfer to other devices, streaming media,firmware updates over the internet, etc. Likewise, TV 123 and stereo 125have wireless transceivers such as BLUETOOTH, Wi-Fi, or other NFCtransceivers, including RFID, and logic onboard for enabling thetransceivers to broadcast an identifier. The broadcast is detected by anappropriate transceiver included within mobile device 101.

Logic onboard mobile device (mobile logic) 101 then transmits, via theappropriate transceiver, a request to connect to one or more ofelectronic devices 121, 123, and 125. The request to connect may includea request for a presentation. The request data packet (or packets) isreceived at the electronic device. The device logic responds with atransmission of a presentation, or layout, of controls used to commandthe electronic device. The presentation is likely in a form defined byan original equipment manufacturer (OEM) of the electronic device. Forinstance, the presentation is provided in an XML format that is readableby the mobile logic. The presentation is received by a mobiletransceiver, and displayed by mobile logic on a display or screen ofmobile device 101. For instance, a mobile remote control application (or“remote control”) is executed on mobile device 101 that includes logicto parse the presentation, retrieve a list of commands and theirassociated layouts, and display the commands to a user of mobile device101. The user executes any command displayed on mobile device 101 bypushing a button or touching a region of a touch-sensitive display(touchscreen) corresponding to the command mapped on the layout. Themobile logic transmits the command back to the electronic device. Thecommand data packet is received, parsed, and executed by device logiconboard the electronic device. For instance, a user commands set-top box121 to change the channel or record a televised program by pushing theappropriate button displayed on the touchscreen of mobile device 101.

The mobile logic is further programmed to control a plurality ofelectronic devices, including set-top box 121, TV 123, stereo 125, andeven router 120. For instance, a user accesses proxy settings onboardrouter 120 via a remote interface presented on mobile device 101.Appliance 127 may be accessed via router 120. Components of building 150may be accessed and remotely controlled via network 140. This feature isfurther described with respect to FIGS. 5 and 6. Additionally, themobile logic permits a user to define a custom remote control for aspecific electronic device or combination of electronic devices. Forinstance, a user specifies that only certain selected commands are to bedisplayed, with the remained hidden. The user may control multipleelectronic devices by creating macros and assigning relationshipsbetween electronic devices. These features are further explained inFIGS. 4 and 5.

Further, although an infrastructure network is shown, theabove-described embodiment may also be implemented in an ad-hoc mannerIn other words, an electronic device broadcasts a specific SID for adirect device-to-device connection. This enables remote control ofdevices without the need for any routers, local area networks, etc., forinstance, in a remote location with limited connectivity (camp, cabin,etc.). Regardless of the type of network, the same information (e.g.,presentation, etc.) is transferred to the mobile device.

FIGS. 2A and 2B show the components of a mobile remote control device,according to an exemplary embodiment of the present subject disclosure.With reference to FIG. 2A, mobile device 201 includes a display 203, anantenna 205, and a microphone 207. With reference to FIG. 2B, mobiledevice 201 further includes a transceiver 209, a central processing unit(CPU) 211, a memory 213, and a power supply 215. Display 203 is an LCD,LED, OLED, liquid paper, or any equivalent display device that is incommunication with CPU 211 and can display a user interface ofsufficient complexity to provide a remote control. Display 203 is shownas a touchscreen, and is therefore considered an input and outputdevice. Microphone 207 provides a means for transmitting oral commands,as well as for verbal communication across, for instance, a telephonenetwork. Antenna 205 is a transducer designed to transmit or receiveelectromagnetic waves (such as RF signals), and transceiver 209 is amicroprocessor designed to process incoming signals and to transmitsignals via antenna 205. Transceivers enable communication with otherdevices across a network or communications path. Transceiver 206 may bea cellular, wireless LAN, BLUETOOTH, etc. Transceiver 209 receivesinstructions from CPU 211 pursuant to mobile logic 214 stored on memory213. CPU 211 controls the other components of mobile device 201including display 203 and microphone 207. Memory 212 includes anycomputer readable medium, such as RAM, ROM, Flash, etc. Power supply 215provides power to each of the components of mobile device 201, and caninclude a battery as well as an interface to an external power supply.Memory 213 stores mobile logic 214, in addition to logic for operatingthe components of mobile device 201.

Logic 214 includes a plurality of logical software components fortransmitting a request for a presentation to electronic devices across anetwork, as well as for transmitting a unique identifier of mobiledevice 201. The unique identifier is any alpha-numeric string ofcharacters that distinctly identify the particular mobile device againstany other mobile or electronic device. For instance, the uniqueidentifier is a MAC address. A combination of values can be used, suchas a MAC address and a serial number. The mobile logic 214 furtherincludes a component for receiving a presentation of a remote controlfrom an electronic device across a network or communication path. Othercomponents of logic 214 include components for parsing the presentationto retrieve a plurality of commands for the electronic device, andmapping the commands to a remote control layout. The remote controllayout may be provided by the electronic device to be controlled.Alternatively, the remote control layout is user defined, as furtherelaborated upon herein. In either case, the presentation is displayed onscreen 203 of mobile device 201. A user remotely controls an electronicdevice by touching or tapping a region of the touchscreen that isdisplaying a particular desired command Command logic in logic 214detects the tap, and transmits a command corresponding to the commandmapped to the region of the layout provided in the presentation. Logic214 further includes customization logic that enables users to definetheir own layout, and to map the commands in the received presentationto the customized layout. The command is transmitted across the networkor a communications path to the electronic device.

In addition to using a touchscreen, a keyboard may be included totransmit more complex information such as text messages or e-mails. Thismay be the case when mobile device 201 is a cellular telephone. Manycellular telephones include hardware capable of performing the functionsof mobile device 201 and support custom logic or software, such as logic214. In fact, mobile device 201 may include any number of transceiversto communicate with assorted wireless and personal area networks and/orcommunications paths.

FIG. 3 shows a communication path between an electronic device and amobile remote control device, according to an exemplary embodiment ofthe present subject disclosure. Communication 324 is bidirectional,enabled via transceivers in both electronic device 323 and mobile device301, and includes both direct connections across a local-area networkLAN (via, for instance, a router), as well as a direct peer-to-peerconnection such as in an ad-hoc network. As shown in the presentembodiment, one aspect of bidirectional communications path 324 isdisplayed on display 303 of mobile device 301. A remote controlapplication 360 displays an indication that a presentation has beenreceived from electronic device 323. Remote control application 360 mayhave initially transmitted a unique identifier of mobile device 301, andin response, received the presentation from electronic device 323.Remote control application 360 additionally provides the user anopportunity to customize a remote or to select a customized remote, bydisplaying buttons 361 and 363. Settings button 365 launches a separatescreen permitting the user to adjust properties of remote controlapplication 360. Help button 367 triggers a context-sensitive helpscreen, answers to frequently-asked questions, or live customer support.

As indicated herein, electronic device 323 may include logic fordetermining that mobile device 301 has permission to act as a remotecontrol. This determination occurs using one or more of several methods,including referring to a whitelist or a blacklist of unique identifiers,using a MAC address filter, etc. Further, group security models may bedefined by an owner/user of electronic device 323. Each group of uniqueidentifiers is assigned a specific set of commands, or a specificpresentation. For instance, a proprietor of a sports bar programs allhis televisions to allow remote control access for regular customersonly. A regular customer requests that the MAC address of his mobiledevice be added to the MAC address filter on each television.Subsequently, regular customers are able to switch the television on,change the channel, etc., simply by using their mobile device, oranother mobile remote control device offered by the proprietor himself.In other embodiments, customers are offered an option to purchase remotecontrol privileges. Referring back to FIG. 3, upon detecting thepresence and unique identity of mobile device 301, television 323 maytransmit a purchase form to remote control application 360. Uponsuccessfully completing the form and transmitting payment, user ofmobile device 301 is able to remotely control television 323. For a userthat refuses to purchase a particular privilege, a limited presentationis transmitted to mobile device 301, which excludes any commands thatthe user did not pay for. The proprietor of the sports bar may allowregulars to change the channel for free, but adjusting the volume is apaid privilege. The limited presentation may be provided with analternate layout excluding or disabling the volume controls. Thus, thepresent subject disclosure provides for layers of permission, offeringeach layer a set of specific commands and customized presentations foreach set. Upon a full reading of this disclosure, a person havingordinary skill in the art will recognize that this feature can beapplied to several diverse situations, such as parental control,authentication, electronic voting/polling, granting access to secureareas, etc.

FIGS. 4A and 4B respectively show an OEM presentation and a custompresentation on a mobile device, according to an exemplary embodiment ofthe present subject disclosure. As described herein, mobile logiconboard mobile device 401 includes customization features, enabling auser to define a custom layout of controls, and re-mapping the receivedcommands to the custom layout. FIG. 4A shows an OEM layout, based uponan OEM presentation received from an electronic device. For instance, atelevision with the identity “OEM PANASONY X420” has approved mobiledevice 401 and transmitted an OEM presentation to mobile device 401. TheOEM presentation includes a plurality of commands to control theelectronic device, as well as a layout. The received presentation isparsed, and displayed as remote control 471 on display 403 of mobiledevice 401. Remote control 471 includes most basic television controls,such as power, volume, channel numbers, and presets/memory controls. Theapplication further enables the user to switch to a custom remotecontrol via button 463.

FIG. 4B shows a custom remote control for PANASONY X420, according to anexemplary embodiment of the present subject disclosure. Although severalcustomization options are available, FIG. 4B shows a very basic controlset, possibly customized for easy viewing, or for someone with limitedfinger mobility. Therefore, the custom remote control 472 includessimple larger buttons for basic tasks. As mentioned above, the layout ofthe controls could take any form, such as XML, HTML, etc. In thisembodiment, the button sizes are increased, certain controls (such asthe channel numbers) are hidden, and a Favorites button is provided toswitch between a user's favorite channels without having to type in anumber. Other adjustments to controls and layouts will become apparentto one of ordinary skill in the art in light of this disclosure. Ineither case, logic onboard mobile device 401 maps the commands for theelectronic device to the specific regions of remote control 472, asdefined by the user. To map commands, a proprietary or open sourcestandard of commands is used. Similar to the pulses of Infrared lighttransmitted by existing remote control devices, commands between mobiledevice 401 and an electronic device follow a defined code or language,such that the remapping process is streamlined. For instance, a standardsignal for powering up/down the electronic device is received in thepresentation, and remapped to the new power button defined by the user.More complex command structures, batches of commands, and macros arepossible.

In other embodiments, commands for more than one device may be mapped tothe same custom remote control. For instance, a user may want a powercommand to control a television, channel commands to control a set-topbox, and volume commands to control an audio system, all on one customremote control. These commands are mapped to the layout of buttons onthe custom remote control. The custom remote control is then stored onthe memory of mobile device 401 so the user can recall the custom remotecontrol at a later time.

FIG. 5 shows a remote control application on a mobile device forcontrolling a plurality of electronic devices, according to an exemplaryembodiment of the present subject disclosure. A remote controlapplication displayed on touchscreen 503 of mobile device 501 is showinga layout of all devices detected within a proximity of mobile device501. The detected devices include television 523, audio system 525,set-top box 521, building 550, appliance 527, and video gaming system529. Possibly, mobile device 501 has received presentations from allthese electronic devices. Alternatively, the layout simply shows a listof electronic devices that are broadcasting their identities. To controla device a user would touch or tap the icon on touchscreen 503. Forinstance, to control television 523, the user would tap icon 523. Thenthe remote control for the television would be displayed, as shown inFIGS. 4A and 4B. Alternatively, if the presentation has not yet beendownloaded, touching icon 523 would trigger the presentation downloadshown in FIG. 3.

In either case, interface 573 additionally shows the relationshipsand/or connections between the electronic devices, and further allowsthe user to refresh 566, define a macro 568, or change the settings 569of the remote control application. Pushing refresh button 566 promptsthe transceiver onboard mobile device 501 to scan the area around mobiledevice 501 for any new electronic devices that are broadcasting theiridentity. Defining a macro 568 enables a user to create a batch ofcommands, potentially controlling multiple devices. For instance, asimple macro includes commands for turning on the set-top box, audiosystem, and television, and could be called “System Power.” Executingthe macro again would switch off these electronic devices. More complexmacros may be envisioned, including defining volume controls forspecific channels, switching inputs from a set-top box to a video-gamesystem, activating a security system in a house, shutting down allappliances when leaving the house, etc.

Further, a user may define relationships between electronic devicesbased upon the connections between the electronic devices. For instance,a relationship is defined between television 523, audio system 525, andset-top box 521. The relationship enables a single layout orpresentation to be used to control both devices. Specifically, pushingthe volume button on a displayed remote control would command audiosystem 525, pushing the power button would control all three devices,and pushing the channel button would control set-top box 521. Othercombinations of commands and relationships are possible. Macros may alsobe used to provide features such as channel lock, volume lock, todisable certain functions on TV and delegate the features to otherdevices (such as the sound system), and so on.

FIGS. 6A and 6B show a system for remotely controlling electronicdevices in a hotel room, according to an exemplary embodiment of thepresent subject disclosure. As described earlier, a mobile remotecontrol device need not be owned by a user, as is in the case of aremote control application on a cellular telephone. In some embodimentssuch as the one shown in FIG. 6A, a plurality of mobile remote controldevices 602 is offered to guests of a hotel. A guest 680 approaches aconcierge 681 to book a hotel room. Concierge 681 goes through thenecessary motions of finding an empty room and assigning the room numberto the guest 680. Concierge 681 then picks a mobile remote controldevice 601 from the plurality of devices 602, and programs mobile device601 with the necessary presentations of the electronic devices in thehotel room. A programming device 682, using any wireless or wiredcommunication technology, provides the presentations for devices in thatparticular room to mobile remote control device 601.

Then, the user walks over to the hotel room 630, as shown in FIG. 6B.

Room 630 includes the following electronic devices: door lock 631,mini-fridge 632, climate control 633, television 635, alarm clock 637,and window shade 639. All of these devices have communication abilities,and are able to be controlled by a mobile remote control device such asdevice 601 provided to guest 680. Similar to the embodiment of FIG. 5, alayout of these electronic devices is provided on a display of mobileremote control device 601, and the user may control one or multipleelectronic devices simply by touching the device on the display andaccessing the remote control presentation of that device. For instance,the user unlocks door 631 and powers on television 635 using mobileremote control device 601. Macros may be defined by the user to activatealarm clock 637 and open window shades 639 at a specified time.Moreover, this system allows for dynamic billing of a user's accountbased upon his remote control choices. For instance, if user 680 decidesto unlock mini-fridge 632, or to watch pay-per-view (PPV) programming ontelevision 635, the remote control 601 would pop up a purchase screen,allowing user 680 to provide his account details or simply to authorizebilling. For a user that refuses to purchase a particular privilege, alimited presentation is transmitted to mobile remote control device 601,which excludes any commands that the user did not pay for. The limitedpresentation is provided with an alternate layout. For purchasedcommands, either instantly or upon returning device 601 back toconcierge 681, the charges are approved and billed to an account of user680. Furthermore, simply having the device within a proximity may beused to trigger a command For instance, a user 680 carrying mobiledevice 601 walks towards room door 631, which automatically unlocks ifthe distance reaches a certain threshold. Further, upon detecting thatmobile remote control device 601 has left the room, electronic devicessuch as TV 635, light, etc. would automatically shut down to save power.

FIG. 7 shows a system for controlling electronic devices using proximityand motion-sensing, according to an exemplary embodiment of the presentsubject disclosure. As mentioned herein, a user carrying a mobile remotecontrol device can use his position and movement as an automatic inputto control electronic devices based on proximity In other words, amovement in a specific direction enables a user to access a resource.The present embodiment shows this in the context of destination priorityelevators in a building 790. These elevators 797 adjust their positionsto where the highest traffic is expected to be, using a series ofalgorithms based on past patterns of use. A controller 795 is used toprogram and control elevators 797. Controller 795 additionallycommunicates with proximity sensors 791 via a network 793. As a user 780carrying mobile device 701 walks along a trajectory 783, the proximityof device 701 is sensed by each proximity sensor 791. The motion of user701, as well as a velocity 783, is transmitted to controller 795. Basedupon this information, known distances within building 790, and currentpositions of elevators 797, a particular elevator is summoned to openjust in time for the arrival of user 780. Further, the optimal choice ofelevators 797 is displayed on mobile device 701, so that user 780 knowsexactly where to go. In some cases, user 780 may input his destinationfloor via mobile device 701, thereby providing valuable additionalinformation for controller 795. For instance, user 780 is a frequentvisitor, as in the case of an employee of a corporation housed inbuilding 790. In this case, a database entry already exists oncontroller 795 for user 780, including the unique identifier of mobiledevice 701, a location within the building of the user's office, atypical time of arrival of user 780, etc. All of these factors, alongwith the user's speed and proximity, are used to provide an input tocontroller 795, so that the most efficient elevator 797 is summoned.

The above-described command input (as a function of proximity andmotion) may be applied to several diverse situations. For instance,computer interfaces are locked and unlocked based upon a proximity ofmobile remote control devices. Privacy concerns may be addressed in thisway. Based on the proximity of an intruder, a different presentation isdisplayed upon a computer. For instance, if the boss walks into a roomwhile the employees are playing a video game, the proximity of the bosstriggers a warning, or a new presentation to be displayed so that theboss remains unaware. This may also be applied to building security andautomations. For instance, doors, windows, and climate-controlcomponents can be activated or de-activated based upon a proximity andnumber of mobile devices in the area. High traffic rooms have moreresources dedicated towards them based on the mobile devices detected inthe room. If each mobile device is used as a remote control, an optimalsetting can be determined based on the number of devices attempting tocontrol the electronic device.

Moreover, the present subject disclosure allows fine-grained detectionof a particular mobile remote control device within a constellation ofremote control devices. Such fine-grain proximity can be used topinpoint users within a volume such as a building, room, car, etc. Thiscan be applied to video game systems too, wherein a camera is used todetect the players in a game. A user holding a particular mobile remotecontrol device with a unique identity is recognized as being an activeuser, so that the camera can ignore the other bodies detected in itsframe. This eliminates any errors of detection by the camera caused by,for instance, lighting conditions, skin tone, etc. Thus, the presentsubject disclosure provides remote control input from a mobile deviceworking in combination with several input devices.

Further, the above-described embodiment may be implemented in both localarea networks, as well as ad-hoc peer-to-peer networks. The proximitysensors would broadcast a specific SID for a direct device-to-deviceconnection, and receive location/movement information directly from themobile device instead of going through a router. Aside from thedifferent type of connection, the proximity detection and velocitydetermination features work in the same manner

Finally, the present subject disclosure may be integrated with otherexisting technologies, such as device controllers or aggregators inmultiple-device environments (such as the home theater described herein)to provide a seamless and productive hassle-free environment. Often, thestate of one or more electronic devices is related to the state of oneor more other electronic devices within the same environment. Forexample, a user may be watching television (TV) when the telephonerings. The user wishes to answer the call, but to effectivelycommunicate with the caller, the user must mute the television so thatsound from the TV does not interfere with the telephone conversation.Pattern recognition and aggregation technologies to remedy this aredescribed in commonly-owned U.S. Pat. Nos. 6,795,404, 7,626,952,7,512,577, and 7,474,667, the contents of which are hereby incorporatedherein in their entirety. The present subject disclosure may beintegrated with these systems to automatically monitor and control aplurality of electronic devices, while establishing device interactionrules based on recognized patterns, and providing streamlinedcommunications paths.

The foregoing disclosure of the exemplary embodiments of the presentsubject disclosure has been presented for purposes of illustration anddescription. It is not intended to be exhaustive or to limit the subjectdisclosure to the precise forms disclosed. Many variations andmodifications of the embodiments described herein will be apparent toone of ordinary skill in the art in light of the above disclosure. Thescope of the subject disclosure is to be defined only by the claimsappended hereto, and by their equivalents.

Further, in describing representative embodiments of the present subjectdisclosure, the specification may have presented the method and/orprocess of the present subject disclosure as a particular sequence ofsteps. However, to the extent that the method or process does not relyon the particular order of steps set forth herein, the method or processshould not be limited to the particular sequence of steps described. Asone of ordinary skill in the art would appreciate, other sequences ofsteps may be possible. Therefore, the particular order of the steps setforth in the specification should not be construed as limitations on theclaims. In addition, the claims directed to the method and/or process ofthe present subject disclosure should not be limited to the performanceof their steps in the order written, and one skilled in the art canreadily appreciate that the sequences may be varied and still remainwithin the spirit and scope of the present subject disclosure.

What is claimed is:
 1. A mobile device, comprising: a processing systemincluding a processor; and a memory that stores executable instructionsthat, when executed by the processing system, facilitate performance ofoperations, the operations comprising: enabling a selection of detectedelectronic devices based on connections between the detected electronicdevices, wherein each of the detected electronic devices is determinedto be in proximity to the mobile device; and presenting a layoutcomprising the detected electronic devices to obtain a displayed layout,wherein a relationship between a plurality of the detected electronicdevices based on the connections facilitates control of the plurality ofthe detected electronic devices.
 2. The mobile device of claim 1,wherein the operations further comprise: receiving an input from a user,mapping the input to a command on the mobile device, and transmittingthe command to one of the detected electronic devices.
 3. The mobiledevice of claim 1, wherein the operations further comprise: enabling auser to define a custom remote control and mapping the custom remotecontrol in the layout.
 4. The mobile device of claim 1, wherein theoperations further comprise: receiving a plurality of inputs from auser; generating a macro based on a plurality of commands, wherein theplurality of commands is based on the plurality of inputs; andtransmitting the macro to the detected electronic devices according tothe connections.
 5. The mobile device of claim 1, wherein the operationsfurther comprise: receiving an input from a user; and generating a macrobased on the input, wherein the macro includes a command applicable tomultiple devices of the detected electronic devices.
 6. The mobiledevice of claim 1, wherein the connections are based on a subset of thedetected electronic devices that share similar functions.
 7. The mobiledevice of claim 1, wherein the presenting of the layout is via atouchscreen display.
 8. The mobile device of claim 1, wherein theoperations further comprise: enabling communication across a cellularnetwork.
 9. A non-transitory machine-readable storage medium, comprisingexecutable instructions that, when executed by a processing systemincluding a processor, facilitate performance of operations, theoperations comprising: transmitting a presentation to a mobile device,wherein the presentation includes identities of a plurality ofelectronic devices and controls for commanding each of the plurality ofelectronic devices; and providing a layout to the mobile device, whereinthe layout includes images representing connections between eachelectronic device of the plurality of electronic devices and otherelectronic devices, and wherein a relationship between the plurality ofthe electronic devices based on the connections facilitates control ofthe plurality of electronic devices.
 10. The non-transitorymachine-readable storage medium of claim 9, wherein the mobile devicereceives an input from a user, wherein the mobile device maps the inputto a command, and wherein the mobile device transmits the command to oneelectronic device of the plurality of electronic devices.
 11. Thenon-transitory machine-readable storage medium of claim 9, wherein eachof the plurality of electronic devices transmits a device-specificpresentation to the mobile device.
 12. The non-transitorymachine-readable storage medium of claim 11, wherein a first electronicdevice of the plurality of electronic devices and a second electronicdevice of the plurality of electronic devices are in communication,wherein the first electronic device comprises a first electronic deviceprocessor, wherein the first electronic device processor performsoperations comprising transmitting a limited presentation to the mobiledevice, and wherein the limited presentation excludes a command includedin the device-specific presentation transmitted by the second electronicdevice.
 13. The non-transitory machine-readable storage medium of claim9, wherein the operations further comprise: receiving a uniqueidentifier of the mobile device; and determining that the uniqueidentifier of the mobile device matches one of a plurality of uniqueidentifiers, wherein the transmitting of the presentation to the mobiledevice is in accordance with the determining that the unique identifierof the mobile device matches one of a plurality of unique identifiers.14. The non-transitory machine-readable storage medium of claim 13,wherein the operations further comprise: determining that the uniqueidentifier matches one of a plurality of lower tier unique identifiers;and transmitting a limited presentation to the mobile device inaccordance with the determining that the unique identifier matches oneof a plurality of lower tier unique identifiers.
 15. The non-transitorymachine-readable storage medium of claim 9, wherein the operationsfurther comprise: receiving a unique identifier of the mobile device;determining that the unique identifier does not match any of a pluralityof unique identifiers of any tier; and transmitting to the mobile devicean offer to purchase a permission to control the electronic devices inaccordance with the determining that the unique identifier does notmatch any of a plurality of unique identifiers of any tier.
 16. Thenon-transitory machine-readable storage medium of claim 9, wherein eachof the plurality of electronic devices is determined to be in proximityto the mobile device.
 17. A method, comprising: generating, by aprocessing system comprising a processor, a graphical layout comprisingconnections between an electronic device and a group of other electronicdevices; determining, by the processing system, a relationship betweenthe group of other electronic devices based on the connections depictedin the graphical layout; and providing, by the processing system, thegraphical layout for presentation on a display, wherein the relationshipbetween the group of other electronic devices based on the connectionsfacilitates control of the group of other electronic devices.
 18. Themethod of claim 17, further comprising: obtaining, by the processingsystem, a unique identifier of a mobile device; determining, by theprocessing system, that the unique identifier of the mobile devicematches one of a plurality of unique identifiers; and transmitting, bythe processing system, the graphical layout to the mobile device inaccordance with the determining that the unique identifier of the mobiledevice matches one of a plurality of unique identifiers.
 19. The methodof claim 17, further comprising: generating, by the processing system, amacro based on a plurality of commands, and transmitting, by theprocessing system, the macro to the electronic device and to the groupof other electronic devices.
 20. The method of claim 17, furthercomprising: receiving, by the processing system, an input from a uservia the electronic device; mapping, by the processing system, the inputto a command on a mobile device; and transmitting, by the processingsystem, the command to one of the group of other electronic devices.